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TAP-SELECTABLE VITERBI EQUALIZER 



Background of the Invention 

The present invention relates generally to a Viterbi equalizer and in particular to a 
tap-selectable Viterbi equalizer. 

Viterbi equalizers are used for decoding intersymbol interference 
channels for digital communication. In decoding an intersymbol interference 
channel, maximum likelihood sequence estimation, implemented with a 
Viterbi equalizer, has a significant performance gain compared to other 
detection techniques. However, the implementation complexity of 
maximum likelihood sequence estimation is generally larger than other 
detection techniques, and the increase in complexity could present a 
challenge for low-power and high-speed implementation. It is therefore 
desirable to reduce the implementation complexity of the Viterbi 
equalizer at the expense of a reasonable, preferably negligible, 
performance loss compared to maximum likelihood sequence estimation. 

A Viterbi equalizer implements the maximum likelihood sequence 
estimation with a recursive approach. The transmitted symbols ai, a 2 ... 
a n are sent through a time dispersive channel, which can be modeled as a 
tapped delay line with coefficients hi, h 2 ... h L . The k'th signal-value out 
of the channel are given as 
i 

r k = ZVV, = V*+Mt-i+»- + M*-M (1) 

/=1 

Here, ak is the current symbol and a^i ... ak-L+i are the previous symbols. 

The state is defined as the set of previous symbols [ak-i ... ak-L+i] 
which are currently in the delay line, and this set has length L-L Since 
each symbol can take X possible values, the total number of possible 
states is given as X L_1 . All the possible transitions between all the states 
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from the previous symbol k-1 (originating state) to the current symbol k 

* * L 1 

(destination state) form a state trellis with X " states. 

The complexity of the Viterbi equalizer, in other words the number 
of states in the trellis, which shows the transition from multiple previous 
5 states to multiple current states, is given as a symbol alphabet raised to 
the length of the channel memory minus one. This length is equal to X L_1 , 
where X is number of different characters per symbol and L the number of 
symbols in a trellis code. Within an environment with X=2, such as a 
^ direct digital representation in which one character, for example "-1", 
S 10 represents a digital zero and one character, for example "1", represents a 
Jl digital one, the complexity is limited and channel lengths of up to 5 symbols will 

not cause a big burden on a signal processor. However, faster standards 
# require more different characters per symbol. For example, X=8 could be 

=. a possible number of characters per symbol in a high-speed application. 

[7 15 Other higher numbers for X are possible to increase transmission speed. 
W As can be readily seen, for example, with X^8, the number of states 
q increases dramatically. 

^ A delayed decision feedback sequence estimator (DDFSE) is a 

technique to reduce the number of states in the trellis by detecting the 
20 older symbols in the tapped delay line. However, the DDFSE can give 
poor performance in cases where the channel energy extends outside the 
DDFSE memory. One way to combat this problem is by applying pre- 
filtering which results in a minimum-phase system. However, this creates 
additional noise and computational load and may result in numerical 
25 instability. 

It is desirable to provide a Viterbi equalizer that reduces the complexity of 
processing power without the disadvantages of the prior art. 
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Summary of the Invention 

According to an embodiment, the present invention provides a method of 
determining a reduced trellis from a sequence of symbols in a Viterbi detector. The 
method includes the steps of determining the value of a previous symbol from the 
5 sequence of symbols, and generating the reduced trellis by calculating only path metrics 
for states in which the previous symbol has the determined value. 

In a more specific embodiment, the step of determining the value comprises the 
steps of determining at least one symbol from a previous determination including a 
_ plurality of current states; determining destination states for the determined symbol and 

y| 1 0 determining a surviving path metric by comparing path metrics originating from the 
^5; states of the determined symbol; and determining the value of a previous symbol with 

CJ respect to the determined symbol of the surviving state. 

2 According to yet another embodiment, the present invention provides a method of 

^ reducing the number of path metric calculations in the trellis of a Viterbi equalizer 
H 15 receiving a sequence of symbols. The method includes steps of performing a preliminary 
P i decision of at least one of the previous symbols in the sequence of symbols; identifying a 
subset of destination states which are excluded from the calculation and determining for 
each of the remaining destination states a survivor path by comparing all path metrics to 
this state. The method also includes the steps of determining the most likely of the 
20 survivor paths and determining the value of the oldest symbol in the symbol sequence 
from this survivor path; and generating the trellis by calculating path metrics only for 
states in which the oldest symbol is identical to the determined value. 

According to another exemplary embodiment, the present invention provides a 
tap-selectable Viterbi equalizer. The equalizer includes means for determining at least 
25 one symbol from a previous determination assigned to a first state, means for determining 
a second state of the plurality of states and determining a surviving path metric by 
comparing path metrics originating from the determined symbol, means for determining 
the value of a previous symbol with respect to the symbol of the surviving state, and 
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calculating means for generating a reduced trellis by calculating only path metrics for 
states in which the previous symbol has the determined value. 

Yet another embodiment of the invention is an arrangement for switching 
between a plurality of equalizers. The switching device is operated based on the power 
distribution in the estimated channel impulse response. 

A more complete understanding of the embodiments of the present invention and 
advantages thereof may be acquired by referring to the following description taken in 
conjunction with the accompanying drawings. 

Brief Description of the Drawings 

Figure 1 shows an equivalent block diagram representing the transmission 
channel characteristics; 

Figure 2 shows the a trellis code determination in a conventional Viterbi 
equalizer; 

Figures 3 A-3C show the trellis code determination in a Viterbi equalizer 
according to a first embodiment of the present invention; 

Figure 4 shows a graph of an example of channel power distribution over time 
associated to three consecutive symbols; 

Figures 5A-5C show the reduced trellis code determination in a Viterbi equalizer 
according to a first embodiment of the present invention; 

Figure 6 shows a graph of an example of channel power distribution over time 
associated to four consecutive symbols; 

Figure 7 shows a block diagram of another exemplary embodiment according to 
the present invention; and 

Figure 8 shows a block diagram of yet another exemplary embodiment according 
to the present invention. 

Detailed Description of the Specific Embodiments 

The various embodiments of the tap-selectable equalizer of the present invention 



allow for improved performance with only a small increase in computation compared to 
the delayed decision feedback equalizer according to the prior art. Further, the present 
invention reduces the need for pre-filtering. The present invention can be useful, for 
example, in wireless phones and base station data receivers, such as for EDGE (Enhanced 
Data rate for GSM Evolution) systems. 

To explain the influence of a transmission channel, Figure 1 shows an equivalent 
block diagram representing the typical characteristics of a transmission channel. The 
transmitted symbol Xk is fed to a box 100 representing the channel modeled as a tapped 
delay line. An additional adder 130 adds white noise nk to the resulting output signal rk 
as shown below: 

h = (2) 
where rk is the transmitted signal consisting of the transmitted complex valued 
symbol x^ which is transformed through the channel by function hk and to which a white 
Gaussian noise nk is added. The operator * designates a convolution operation. The 
complex valued symbol Xk is actually the digital representation of an analog signal. The 
value rk is evaluated within a decision feedback equalizer. Typically the ideal 
representation of a symbol value of digital zero is "-1" and that of a digital one is "1" for 
a dual character symbol environment. However, as mentioned above, one of a plurality 
of, for example, 8 different characters can be represented by a single symbol. 

The function of a typical Viterbi equalizer according to the prior art will now be 
explained in conjunction with Figure 2 which shows the transition of a trellis code 
determination in such a conventional Viterbi equalizer. A 3 -tap Viterbi equalizer 
receives a sequence of three symbols a^, ak-i, and ak. These three symbols and following 
sequences will be evaluated within the Viterbi equalizer as follows: a L-tap Viterbi 
equalizer, which has 2 L_1 states, calculates all path metrics pk which reflect the probability 
for a symbol ak within a sequence of L symbols, wherein ak is the last symbol in that 
sequence. To this end, in a 3 -tap Viterbi equalizer as shown in Figure 2, all path metrics 

p x k for all four possible combinations of the previous two symbols ak-2 and ak-i have to be 
determined. The left column in Figure 2 shows all four possible combinations for ak-2 



anda k ,i, namely "-1,-1", "-1,1", "1,-1", and "1,1". Each combination has a previously 
calculated path metric p\_ l9 p\_ x , j^_ 1? and p\_ x . There exist eight transition path 
metrics resulting in four future "a k -2 and a k -i", which in this determination process are a k -i 
and a k and shown on the right column in Figure 2. To determine the four surviving path 

metrics p* k , each pair of transitions for each state is compared and only the best is taken 

(survives). As mentioned above the next symbol "a k+ j" becomes a k and the other symbols 
are respectively shifted for the next determination process. 

Figure 4 shows a graph of an example of the estimated channel power distribution 
according to a channel impulse response over time associated to three consecutive 
symbols. To reduce the number of states in the trellis, a channel impulse estimate is 
determined, so that the preliminary symbol detection is done only for the tap-coefficients 
with an energy level larger than a certain threshold, set relative to the strongest tap- 
coefficient. If more than a specific number of taps have sufficient energy, then only the 
strongest are selected. For the weakest tap or taps, a preliminary symbol decision is 
made. Based on these preliminary symbol decisions, only a subset of the states in the 
trellis has to be considered. 

The power distribution shown in Figure 4 indicates that Y12 has a low power level 
and therefore only gives a minor contribution to the branch metric calculation compared 
to the stronger channel coefficients hi and h 3 . Thus, this sequence is ideal for the method 
described below. 

The four 4-state Viterbi equalizer according to Figure 2 recreates a sequence of 
symbols by calculating the probabilities for all possible sequences. The sequence which 
gives the best fit between the real received sequence and the recreated sequence is then 
selected. A sequence is given as: 

L 

where r k ( k =i...N) is the known received signal and hi q=\,„l) are the estimated channel 
coefficients and a k (k=i...N) are the unknown transmitted symbols and n k (k=i...N) is the 
unknown white Gaussian noise. Figure 2 shows the functionality of a 4-state Viterbi 



equalizer. The current state represents the sequence of two symbols, namely ak-2 and ak-i. 
Therefore, four possible sequences are depicted by numerals 1-4. For the next state 8 
sequences are possible which are reduced to 4 possible states by means of a minimum 
decision. The minimum decision selects the path with the lowest path metric or the 
highest probability. The path metric pk is given by cumulating all the branch metrics bk: 

k 

Pk = £ b , (4) 

] = 1 

where the branch bk metric is defined as 



-^k _ ^i^k-i (^) 

i = l 

Thus the path metrics pk are defined as: 

p\ = min(flt_, + b k , p\_ x + b k ) (6) 

p 2 k = min(^_, + bl 2 , p\_ x + bf ) (7) 

p\ = min(/£., + bf , pt_ x + b? ) (8) 

pt=min( P l l+ b 2 k \pi l+ b?) (9) 
wherein 

K y =r k - {aUh, + al_ x h 2 + a? hi ) (10) 

P k represents the survivor path for the k'th symbol in the respective state x and 

is the branch metric between state x and state y for the k 1 th symbol. Thus, a Viterbi 

equalizer is able to calculate the most likely next symbol in a sequence of symbols. The 
results of former calculations will influence the current decision as can be seen from the 
above equations. Although Figure 2 shows a 4-state Viterbi equalizer, a Viterbi equalizer 
with a different number of states can be used. As can be readily seen, the amount of 
calculations is quite moderate when L=3 and each symbol can adopt only two different 
characters (here -1 and 1). However, if the trellis code has, for example, five symbols 
and the number of characters within a symbol is 8, the number of calculations becomes 
excessive and puts a burden on a digital signal processor. 
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Therefore, a first embodiment of a Viterbi equalizer according to the present 
invention will now be explained in conjunction with Figures 3A-3C. Again, a 3-tap 
trellis code is used with binary characters for each symbol. The resulting four states are 
numbered 1-4 from top to bottom. The following steps will now be performed: 
Step 1 : performing a preliminary decision of at least one of the previous symbols in the 
sequence of symbols; 

Step 2: identifying a subset of destination states which are excluded from the calculation 
and determining for each of the remaining destination states a survivor path by 
comparing all path metrics to this state; 

Step 3: determining the most likely of the survivor paths and determining the value of the 
oldest symbol in the symbol sequence from this survivor path; and 
Step 4: generating the trellis by calculating path metrics only for states in which the 
oldest symbol is identical to the determined value. 

Turning now to Figure 3 A, at that time no path metrics for p x k have been 

calculated. However, path metrics for p x k _ x are present, indicating which character for 

ak-i was most likely. In this example, state 2 is assumed to have the highest probability 
and therefore "1" is assumed to be the most likely character for ak-i. This state can 
transition to either state 3' or 4 f depending on the character of ak. Therefore, only state 2 
and state 4, both ending at the same states 3' and A\ will be considered in the next step. 

The next step is shown in Figure 3B. In this step, the survivor pair of these four 
transitions is determined. To this end, the probabilities of both paths for each state are 
calculated. It is again assumed that the transitions of state 2 generate the highest path 

metric pairs p\ and pi . Thus, the most likely character for a^2 (the oldest symbol in the 

tapped delay line) can now be determined. In the present example, this character would 
be a r! -l" as indicated by the numeral 400. If the decisions on a^ differ, then ak-2 is 
derived from the state with the smallest survivor path metric. 

In the last step, shown in Figure 3C the starting points for the transition 
calculation are determined to be state 1 and state 2, as ak-2 is equal "-1" for both states 
(indicated by numerals 400 and 41 0 in Figure 3C). The remaining transitions will not be 
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calculated, and therefore branch and path metrics do not have to be calculated. 
Furthermore, no comparison of the respective values is necessary. 

Figures 5 A-C show the transition of a trellis code determination in a Viterbi 
equalizer according to a second embodiment of the present invention. For a better 
overview the digital representation using "0" and "1" instead of the mathematical 
representation of M -l M and " 1 " is used throughout the following figures. The respective 
channel power distribution is shown in Figure 6. As can be readily seen, the power 
distribution for signals h 2 and h 3 are lower than for hi and I14. In this 4-tap example of a 
trellis sequence, it is assumed that previously state 3 had the minimum error or highest 
probability. Thus, the sequence for a k -2 and a k -i is "1, 0 M . As described above, in the next 
step it is determined that only transitions of state 3 and 7 are calculated which result in 
the next state 5 f and 6\ In Figure 5B, it is assumed that previous state 3 provides the 
survivor paths. Thus, as indicated by numeral 600, a k _ 2 is determined as "0". With this 
decision made, all "0" characters for a k _ 3 will be used as indicated by numerals 600, 610, 
620, 630 in Figure 5C. In the following step the starting points 600, 610, 620, 630 for the 
transition calculation are used to calculate the respective path metrics. Again, the 
remaining transitions will not be calculated, and therefore branch and path metrics for 
those starting points do not have to be calculated as indicated by the dotted lines in Figure 
5C. Thus, no comparison of the respective values is necessary. 

The complexity can be evaluated as follows: the calculations can be divided into 
the number of path metric calculations, the number of survivor calculations, and the 
number of path metric calculations to populate the trellis. Table 1 shows calculation 
requirements for three different schemes, wherein VE indicates a Viterbi Equalizer as 
shown in Figure 2, DDFSE indicates a Delayed Feedback Sequence Estimator, and TS- 
VE a Tap-Selectable Viterbi Equalizer according to the present invention, ja defines the 
number of states used in step 2 (Partial Viterbi) of this invention. 



TABLE 1 





Path Metrics 


Survivor 


Populate 


VE 




X 


L 




X 


L-l 


0 


DDFSE 




X 


JU+l 




X 


M 


0 


TS-VE 




X 






X 


M 





Although it uses more calculations than the Delayed Decision Feedback Sequence 
Estimator, the Tap-Selectable Viterbi Equalizer uses much less than the standard Viterbi 
Equalizer and does not show the disadvantages of the DDFSE as explained previously. 
Table 2 shows the number of calculations as an example for a 5-tap channel, with 

X\ -8. 

TABLE 2 





Path Metrics 


Survivor 


Populate 


VE 


32768 


4096 


0 


DDFSE 
[H=3] 


512 


64 


0 


TS-VE 


512 


64 


4032 



Figure 7 shows a block diagram of another exemplary embodiment according to 
the present invention. To combine the best of all techniques, Figure 7 shows a Viterbi 
equalizer 910, a Delayed Decision Feedback Sequence Estimator 920 and a Tap- 
Selectable Viterbi Equalizer 930. All three equalizers receive the same input signal from 
terminal 900. A control device 940 is determining through a switch 950 which equalizer 
is used. The selected output signal is then fed to terminal 960. Of course, in other 
embodiments the Tap-Selectable Viterbi Equalizer 930 is one of at least two equalizers 
used in such a configuration, where the multiple equalizers receive the same input signal 
and a control device 940 determines through a switch which of the multiple equalizer's 
output to use. 
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Figure 8 shows another embodiment in which the switch referred to by numeral 
970 is moved to the input side of the multiple equalizers. Thus, the input of one of the 
three equalizers is fed with the input signal received at terminal 900 and accordingly one 
output from the selected equalizer is output at terminal 960, according to this 
embodiment. The control device 940 (similar to that of Figure 7) is shown in more detail 
in Figure 8 as including a channel estimator 935 which receives the input signal and 
generates an output signal fed to the switch control device 945 which controls the switch 
970. Again, in other embodiments the Tap-Selectable Viterbi Equalizer 930 is one of at 
least two equalizers used in such a configuration, where one of the multiple equalizers is 
selected to receive the input signal, as determined by a control device 940, and thus to 
provide that equalizer's output. 

Control device 940 determines the selection based on the channel impulse 
response estimate. To this end, either the current channel power distribution as shown in 
Figures 4 and 6 or any other suitable information about the channel characteristics can be 
used. In Figure 8, a channel estimator 935 is used to determine the channel power 
distribution. Assume that the channel length is 4 taps. For example, according to Figure 
6, when all hi, h.2, I13 and I14 are approximately equal the standard Viterbi equalizer is 
used. When hi and I12 are large and h 3 and I14 are small the DDFSE is used; and when hi 
is large, I12 is small, I13 is large and I14 is small the Tap- Selectable Viterbi Equalizer is 
selected. 

Generally, the standard Viterbi Equalizer is used when the channel has a long 
impulse response, and thus many taps in the sequence have a high energy level. 
Whenever a short impulse response is present, the Delayed Decision Feedback Sequence 
Estimator is used. In this case, there will be only a few taps with a high energy level, 
(such as when hi and h 2 are large and h 3 and h 4 are small as discussed above). Whenever 
a low energy tap is located in the middle of a sequence, the Tap-Selectable Viterbi 
Equalizer is selected (such as when hi is large, I12 is small, I13 is large and I14 is small as 
discussed above). In an embodiment with only a Tap-Selectable Viterbi Equalizer and a 
Delayed Decision Feedback Sequence Estimator, the Tap-Selectable Viterbi Equalizer is 
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then selected only if there is a low energy distribution in the middle of the symbol 
sequence. 

As generally discussed above, another embodiment according to Figure 9 includes 
only two of the three shown equalizer units, for example, the Tap-selectable Viterbi 
Equalizer and the regular Viterbi Equalizer or the Delayed Decision Feedback Sequence 
Estimator. Yet another embodiment comprises the regular Viterbi Equalizer and the 
Delayed Decision Feedback Sequence Estimator. A plurality of different equalizer units 
can be implemented, whereby each equalizer unit is suitable to calculate a trellis for a 
specific power distribution of a respective symbol sequence. All exemplary 
embodiments can be preferably implemented by a suitable digital signal processor. 

In summary, the method of determining a reduced trellis from a sequence of 
symbols in a Viterbi detector according to an exemplary embodiment of the present 
invention includes determining the value of a previous symbol from the sequence of 
symbols; and generating the reduced trellis by calculating only path metrics for states in 
which the previous symbol has the determined value. The step of determining the value 
of a previous symbol can include the steps of determining at least one symbol from a 
previous determination including a plurality of current states; determining destination 
states for the determined symbol and determining a surviving path metric by comparing 
path metrics originating from the states of the determined symbol; and determining the 
value of a previous symbol with respect to the determined symbol of the surviving state. 

Preferably, the previous symbol is the oldest symbol. More specifically for longer 
sequences having n symbols, the previous determination usually includes a sub-sequence 
of n-1 symbols. Thus, the determination of at least one symbol can comprises a sub- 
sequence of up to the last n-2 symbols. The method can further be executed depending 
on power distribution of said sequence of symbols and in addition can be performed for 
those sub-sequences in which the power distribution of the n-2 symbols is below a 
predefined threshold. 
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